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TECHNICAL FIELD 

The present invention relates to both convolutional 
decoding and to turbo decoding for communications applications 
and in particular to mobile, point-to-point and satellite 
communication networks, CDMA (Code Division Multiple Access) and 
OFDMA (Orthogonal Frequency Division Multiple Access) cellular 
telephone and wireless data communications with data rates to 
multiple Tl (1.544 Mbps) and higher (>100 Mbps), and to optical 
WDMA (Wavelength Division Multiple Access) links with data rates 
to >100 GBps (Gega bit per second) and higher ranges. More 
specifically the present invention relates to novel a-posterior 
probabilities and decisioning metric paradigms and architectures 
which reduce the number of arithmetic multiply operations and 
thereby reduce the computational complexity, improve iterative 
convergence thereby reducing compexity, improve bit error rate 
BER performance, and provide new metric processing algorithms to 
support the various decoding algorithms. 
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BACKGROUND ART 

Current art is represented by the recent IEEE publication 
in reference [1] which summarizes the theorectical and 
applications work on turbo codes, books on turbo codes in 
references [2], [3], [4], the paper by Viterbi in reference [5] 
which formulates the maximum a-posteriori MAP turbo decoding 
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algorithm in terms of the convolutional decoding maximum 
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algorithm in terms of the convolutional decoding maximum 
likelihood ML algorithms, the IEEE publications and articles 
addressing turbo decoding in references [6] ,[7] ,[8], and the 
reference text on the theorectical foundations of probability and 
5 decisioning metrics [9] . In addition there are the fundamental 
patents on turbo decoding. 

Decisioning metrics DM currently used in turbo and 
convolutional decoding are the natural logarithm of the 
conditional Gaussian probabilities of the observed output symbol 
10 y at clock k corresponding to the received codeword k, assuming 
that the transmitted symbol is x at k. This defines the 
decisioning metric DM in equations (1) where In is the natural 
logarithm and log is the logarithm. When we refer to log it is 
understood that we mean the natural logarithm since it is always 

15 

Decisioning metric DM (1) 

1 Gaussian conditional probability p(y|x) 

p(y|x) = exp(-|y-x| 2 /2a 2 ) / (2n) 1/2 a 

2 Log of the Gaussian 

20 ln[p(y|x)] =-|y-x| 2 /2a 2 -In [ (2tc) 1/2 a] 

3 Decisioning metric DM is the negative of the log 
with the additive constant term removed 

DM(y,x) = -|y-x| 2 /2a 2 

25 used in turbo decoding and in convolutional decoding. Step 1 is 
the definition of the zero-mean conditional Gaussian probability 
density function. Step 2 is the log. Step 3 is the decisioning 
metric DM that measures the distance between y and x, where a is 
the one sigma value of the inphase and the quadrature noise. This 

30 DM metric is used in the convolutional decoding algorithm, and in 
the turbo decoding algorithm when combined with the a-priori 
probability of the correct decoding bit. The DM metric is a 
distance metric and the functional form is determined by the 



2 



zero-mean Gaussian assumption for the link and receiver 
processing noise. 

MAP turbo decoding starts with the assumptions that we are 
decoding a sequence of observed channel output symbols {y(k), 
5 k=l,2,...,N} of the receiver where k is the running index over the 
N transmitted symbols. Each set y(k) of symbols for codeword k 
consists of the observed uncoded and coded symbols for the 
received codeword k. 

FIG. 1 is a representative turbo encoder block diagram for 

10 a parallel architecture. Input 1 to the encoder are the user data 
bits {d(k)} for k=l,2,. . . ,N. The encoder for a turbo code uses 
a recursive systematic code RSC which means the first codeword 
bit 2 is the user data bit called systematic bit, or bits, which 
are uncoded. These user data bits {d(k)} are also handed over 

15 to the first RSC encoder 3 called #1 encoder, and after 
interleaving 4 are also handed over to the second RSC encoder 5 
called #2 encoder. User data bits and the encoder output bits 
are punctured 6 to obtain the correct code rate and then 
multiplexed into a continuous output bit stream 7 of codewords 

20 {c(k)} for each of the codeword clocks k=l,2, ,N. Each 

codeword c(k) is a set of bits consisting of the systematic bits, 
#1 encoder output bits, and #2 encoder output bits. 

FIG. 2 is a representative transmitter block diagram for 
implementation of both the turbo encoder in FIG. 1 and the 

25 convolutional encoder in FIG. 7. Signal processing starts with 
the input stream {d(k)} of user data bits 8 to the 
convolutional/turbo encoder 9. Output 10 of the 
convolutional/turbo encoder in FIG. 1 are the stream of codewords 
{c(k)} handed over to the frame processor. Frame processor 11 

30 accepts these codewords and performs error detecting coding such 
as a CRC (cyclic redundant code) and frame formatting, and 
passes the outputs to the symbol encoder 12^whose outputs are the 
transmitter symbols {x(k)} corresponding to the codewords of the 
convolutional/turbo encoder output as well as the -other symbols 

35 for the frame data including the CRC. Framing CEffi pe done before 
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and/or after the turbo encoding. Transmitter symbols {x(k)} are 
modulated 13 into a waveform. Modulator output signals for 
multiple channels are multiple-access processed and combined 14 
for handover 14 as a stream of complex baseband digital signal 
5 samples {z(ti)} where ti is a time index, to the digital-to- 
analog conversion processing 15 which converts the complex 
baseband input signal from the multiple access processing into a 
single sideband SSB upconverted real signal v(t) 15 at an 
intermediate frequency IF where {z(ti)} is the stream of complex 

10 baseband signal input samples at the digital times {ti} to the 
digital-to-analog conversion. The digital-to-analog processing 
also includes beam forming calculations for both digital and 
analog beam-forming antennas. Multiple access examples in 14 
are time division multiple access TDMA, frequency division FDMA, 

15 code division CDMA, space division SDMA, frequency hop multiple 
access FHMA, and all combinations of these and others not 
mentioned but inferred from this representative list. 

For multiple beam antennas 16 in FIG. 2 the beam 
coefficients for each beam element for each complex digital 

20 sample are processed 15 and the individual digital streams are 
handed off to the corresponding antenna elements where they are 
SSB upconverted to an IF and processed by the analog front end 
16 at each element and the array of elements form the beams and 
within each beam the transmitted signal is similar to the real RF 

25 signal v(t) in 17 for a single beam. For single beams the 
analog front end 16 upconverts and amplifies this IF signal and 
transmits it as the real RF signal v(t) 17. This real waveform 
v(t) 17 is at the RF carrier frequency f 0 and is the real part 
of the complex envelope of the baseband waveform z(t) multiplied 

30 by the RF carrier with the phase angle <() which accounts for the 
phase change from the baseband signal to the transmitted signal. 

MAP joint probability used in the MAP turbo decoding 
algorithm is defined in equations (2) which are taken from 
references [1],[2]. Definition 1 introduces common terminology in 
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MAP joint probability for turbo decoding (2) 

1 Definitions 

S(k) = Decoder trellis state at clock k 
5 = Decoder shift register state at clock k 

s',s = Values of S(k-l), S(k) respectively 
y = Set of observed channel output symbols 

= {y(k) / k=l,2,...,N} 
y(k) = Output symbols for codeword k 
10 = {y(k,b)} where b refers to a codeword bit 

= (y(k), y(k), y(k)} for both #1 encoder 
and #2 encoder depending on the text 
y(k,b=l) - uncoded bit(s) in codeword k 
RSC = Recursive systematic code 
15 = Systematic code SC with feedback which is a 

requirement for turbo decoding 
Parallel encoding = Encoding configuration for turbo 
decoding which transmits the symbols using a 
parallel architecture, which is the assumed 
20 architecture for this invention disclosure 

y(k) = Output symbols for codeword/clock k 
(y(j<k)} = Output symbols for clocks j=l, 2, k-1 
{y(j>k)} = Output symbols for clocks j =k+l , , 2 , N 

2 Decoding states and observations 

25 Observations are the set {y(k), k=l,2,...,N) 
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1 k = 1,2,...,N N 
Subsets y ( j<k) , y ( k) , y ( j>k) of y are of interest 
30 I I I I * "»l 

N 



y(j<k) y(k) y(j>k) 
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Decoder trellis states of interest are s',s 
| -»| | | ->| 

k-1 k k+1 n 

S(k-l)=s' S(k)=s 

3 MAP joint probability 

The joint probability of interest for MAP is 
P(s',s,y) =p(s',s, y(j<k) ,y (k) ,y(j>k) 



turbo decoding literature. In 2 the decoding states s',s are 
defined at clocks k-l,k and the observations are defined over the 
j=l, 2, k-1 as y(j<k), over j=k+l,...,n as y(j>k), and at k as 
y(k). In 3 the MAP joint probability is defined as a function of 

15 these decoder states and observations. 

Recursive equation for the MAP joint probability is derived 
in equations (3) by reformulating the joint probability equation 
in 3 in equations (2) as a function of the recursive state 
estimators a, p and the state transition probability y. Step 1 

20 is the application of Bayes rule to partition the joint 
probability. Step 2 takes advantage of the assumption that the 

Recursive formulation of MAP joint probability (3) 

1 Bayes theorem or rule p (a, b) =p (a I b) p (b) can be used to 
25 rewrite the MAP joint probability in 3 in equation (2) 

p(s',s,y) = p(s',s, y (j<k) ,y (k) ,y ( j>k) 

= p(y(j)>k|s' /S , y(j<k) ,y(k) ) 
*p(s',s, y(j<k),y(k)) 
where is a multiply operation 

30 2 Assuming the channel is memoryless 

p(s',s,y) = p(y(j)>k|s) p(s',s, y(j<k) f y(k)) 
3 Re-applying Bayes rule and the assumption that 
the channel is memoryless 

p(s',s,y) =p(y(j>k)|s) p(s,y(k)|s') p(s',y(j<k)) 
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4 This equation can be rewritten as a function of the 
recursive estimators and state transition probability 
p(s,s',y) = p k (s) y k (s,s') a k _i(s') 
5 where by definition 

Pk(s) = p(y(j>k) Is) 
y k (s,s' ) = p(s,y(k) |s' ) 
ctk-i(s' ) - p(s' ,y (j<k) ) 

10 channel is memoryless to simplify the partitioning in step 1. 
Step 3 re-applies the Bayes rule and the memoryless assumption to 
re-partition the equation and simplify it to the final form used 
in the MAP algorithm. Step 4 transforms the joint probability in 
step 3 derived as a product of three probabilities , into the 

15 equivalent product of the two estimators a k _i(s') ,p k (s) and the 
state transition probability y k (s,s')for the MAP algorithm. 

Forward recursive equation for the state estimator a k (s) is 
derived in equations (4) as a forward recursion which is a 
function of y k (s,s') and the previous estimate a k _i(s'). Step 1 

20 starts with the definition of cc k (s) which is derived from the' 
equation for a k _i(s') in 4 in equations (3). In step 2 we 
introduce the state s' by observing that the probability summed 
over all values of s' is equal to the probability with s' 
excluded. In step 3 we apply Bayes rule to partition the 

25 probabilities. In step 4 the assumption that the channel is 
memoryless enables the equation to be simplified to the form used 

Forward recursive equation for a k (s) (4) 

1 Definition of a k -i(s') in 4 in equations (3) gives 
30 a k (s) = p(s,y(j<k) ,y(k)) 

2 This probability can be written as the sum of 
joint probabilities over all possible states of s' 
a k (s) - Sans- p(s,s' ,y(j<k) ,y(k) ) 
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3 Applying Bayes rule 

a k (s) = Zaii s' p(s,y (k) |s' ,y (j<k) )p(s' , y (j<k) ) 

4 Applying the channel memoryless assumption 
a k (s) = Zan S ' p(s,y(k) |s' )p(s' ,y(j<k) ) 

5 5 Substituting the definitions of y k (s,s') and 

a k _i(s') from 4 in equations (3) 
a k (s) = Zaii s' Yk(s / s / ) a k _i(s') 

in the MAP algorithm. In step 5, substitution of y k (s,s') and 
ot k -i(s') from 4 in equations (3) gives the final form for the 
recursive equation for a k (s) . 

Backward recursive equation for the state estimator (3 k -i(s') 

is derived as a backward recursion in equations (5) as a 
function of the y k (s,s') and the previous estimate p k (s), 
following the steps in equations (4). Step 1 derives p k -i(s') 
from the equation for p k (s) in 4 in equations (3) . Step 2 
follows steps 2,3,4 in the derivation of <x k (s) in equations (4). 

Backward recursion equation for p k -i(s') (5) 

1 The definition for p k (s) from 4 in equations (3) 
Pk-i(s' ) = p(y(j>k-l) Is' ) 

2 Following steps similar to steps 2,3,4 in equations (4) 
Pk-i(s') = Zaii s P(y(j>k) |s)p(s,y(k) Is') 

3 Substituting the definitions of y k (s,s') and 
p k (s) from 4 in equations (3) 

Pk-i(s') = Zaii a Pk(s) y k (s,s') 

In step 3, substitution y k (s,s') and P k (s) from 4 in equations 
(3) gives the final form for the recursive equation for p k _i(s'). 
30 State transition probability Yk(s,s') and the log YkCs^s') 

are derived in equations (6). The y k (s,s') is the probability of 

8 
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State transition probabilities Yk(s,s' ) ,Yk(s,s' ) (6) 

1 From the definition of y k (s,s') from 4 in equations (3) 
and Bayes rule 

5 Yk(s / s') = p(s,y(k) |s') 

= p(y (k) |s,s' ) p(s|s' ) 

2 Define 

d(k) = input bit necessary to cause the 

transition from state S(k-l)=s' to S(k)=s 
10 p(d(k)) = a-priori probability of d(k) 

x(k) = transmitted codeword symbols defines the 
transition from S(k-l)=s' to S(k)=s 
= {x(k,b)) where b refers to the codeword bit 
y(k) = received codeword symbols defined by the 
15 transition from S(k-l)=s' to S(k)=s 

= {y(k,b)} where b refers to the codeword bit 

3 With these definitions and the memoryless assumption, 
the Yk(s,s') equation in 1 becomes 

y k (s,s') = p(y(k) |s,s') p(d(k)) 
20 = P(y(k) |x(k) ) p(d(k) ) 

= fib P(y(k,b) |x(k,b) ) p(d(k) ) 

4 Assume the channel is Gaussian and the symbols are BPSK 
Y k (s,s')=n b exp( -|y(k,b)-x(k,b) 1 2 /2a 2 ) / (2ti) 1/2 a 

* P(d(k)) 

25 5 The DM from 3 in equations (1) can be rewritten 

DM(s|s')= L b DM (y (k,b) , x (k,b) ) 

= E b -|y(k,b)-x(k,b) | 2 /2g 2 
6 Log equation for yx(s,s') takes the log, 
uses DM, and deletes the additive constant 
30 Xk(s,s' ) = DM(s|s' ) + p(d(k) ) 

the decoder trellis state S(k-l)=s / transitioning to the next 
state S(k)=s symbolically written as s'->s. In step 1 we apply 
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Bayes rule to the definition of Yk(s,s') in 4 in equations (3). 
Step 2 are definitions. Step 3 uses these definitions to 
transform the Yk(s,s') into the product of the conditional 
probabilities p(y(k)|x(k)) of the received codeword symbols 
5 {y(k)} given the transmitted codeword symbols {x(k)}, and the a- 
priori probability p(d(k)) causing this transition. The 
p(y(k)|x(k)) is the product over the bits b=l,2,... for the #1 or 
#2 encoders in FIG. 1 depending on which is being addressed, of 
the probabilities for each bit p (y (x,b) I x (k,b) ) . 

10 In step 4 we introduce the standard turbo code assumption 

that the channel is Gaussian and uses BPSK (Binary phase shift 
keying) symbols which means d(k)=+/-l when interpreted as a BPSK 
symbol, and a is the one sigma Gaussian inphase and 
quadraturenoise . In step 5 we observe that the DM metric is a 

15 function of the states s,s' which is equal to the sum of the DM 
metrics over the bits {b} of the codeword corresponding to the 
transition from S(k-l)=s' to S(k)= s. In step 6 the equation 
for the log ]k(s f s') of y k (s,s') as a function of the DM metric 
and the log p(d(k)) of p(d(k)), is used in turbo decoding 

20 algorithms, and in convolutional decoding algorithms when p(d(k)) 
is deleted. 

Log equations for Ok(s) , J3k-i(s') are derived in equations 
(7) from equations (4), (5) respectively for a k (s), Pk-i(s') 
using the definition of ¥k(s,s') in 6 in equations (6). Step 1 
25 gives the log equation for a k (s) by taking the 

Log equations for Ok(s) , J3k-i(s') (7) 
1 Log ctkts) 

a k (s) = ln[E alls , expia^is' )+DM(s|s' )+ p(d(k))] 
30 2 Log J3]c-i(s') 

fik-i(s')= ln[ Zaiisexp ( g k (s)+DM(s|s' )+ p(d(k))] 
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log of the a k (s) equation in 5 in equations (4) and using the 
definition of ¥k(s,s') in 6 in equations (6). Step 2 takes the 
log of the equation for pk-i(s') in 3 in equations (5) to derive 
the log equation for J3 k _i(s') and uses the same definition for 
tkis, s' ) . 

MAP equations for the log likelihood ratio L(d(k)|y)) are 
derived in equations (8) . Step 1 is the definiton from references 
[1],[2]. Step 2 uses the Bayes rule P (a, b) =P (a | b) P (b) with the 
p(y) cancelled in the division. Step 3 replaces p(d(k)) with the 

MAP equations (8) 

1 Definition 

L(d(k) ) |y) = ln[ p(d(k)=+l|y) ] 
-ln[ p(d(k)=-l|y) ] 

2 Bayes rule allows this to be rewritten 

L(d(k) ) |y) = ln[ p(d(k)=+l,y) ] 
-ln[ p(d<k)=-l,y) ] 

3 Probability of p(d(k)) is the sum of the probabilities 
that the state S(k-l)=s' transitions to S(k)=s for the 
assumed values d(k)=+l and d(k)=-l 

L(d(k) ) |y) = ln[ S (s /S ' id(k)=+i) P (s, s' , y) ] 
-ln[ I {s ,s'id(k)=-i} P(s,s' f y) ] 

4 MAP equation is obtained by substituting the 

log Ok-its' ) ,J3 k (s) , i k {s,s') into 3 
L(d(k) ) ty) = ln[ I (s,s' |d(k)=+l) P(S,S',y)] 
-ln[ E( S(S 'id(k)=-i) p(s,s',y) ] 

= ln[Z (s , sMd(k)=+1 , exptak-ifs' )+DM(s|s' )+E(d(k) )+g k (s) ) ] 
-ln[Z {s , sMd(IC)= _ 1 , exp(a k -i(s' )+DM(s|s' )+p(d(k) )+fi k (s) ) ] 

5 Decide d(k) = +1 when L(d(k)|y) > 0 

= -1 when L(d(k) |y) < 0 
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equivalent sum of the probabilities that the transition from 
S(k-l)=s' to S(k)=s occurs for d(k)=+l and for d(k)=-l. Step 4 
substitutes the log of the recursive estimators <x k -i (s' ) , fik(s) , 
from 1,2 in equations (7) and the state transition probability 
5 Yk(s,s') from 6 in equations (6). In step 5 the hard decisioning 
rule is d(k)= +/-1 iff L(d(k)|y) >/< 0 and the soft decisioning 
metric is the value of L(d(k)|y). 

MAP turbo decoding iterative algorithm is defined in FIG. 3 
and in equations (9) for a parallel architecture using the MAP a- 

10 posteriori equation in equations (8) with BPSK (Binary Phase 
Shift Keying) modulation. This basic algorithm is used to 
illustrate how the decisioning metric DM is implemented, and is 
representative of how the DM metric is used for the more 
efficient algorithms such as the Log-MAP, Max-Log-MAP, iterative 

15 SOVA , and others, for parallel and serial architectures and 
other variations, and for modulations other than BPSK. 

FIG. 3 inputs are the detected soft output symbols 18 
from the received channel demodulator which detects and recovers* 
these symbols. This stream of output symbols consists of the* 

20 outputs {y(k,b=l)} for the systematic bit b=l which is the 
uncoded bit, the subset of the output symbols from #1 decoder 3 
in FIG. 1, and the remaining output symbols from #2 decoder 5 in 
FIG. 5. Systematic bits are routed to both #1 decoder 20 and #2 
decoder 21. Encoded bits from #1 and #2 encoders are separately 

25 routed 19 to #1 and #2 decoders. The detailed decoding in FIG. 3 
will be described in parallel with the MAP turbo decoding 
iterative algorithm in equations (9). In equations (9), step 1 
defines the various parameters used in the turbo decoding 
iterations . 

30 Step 2 starts iteration k=l in FIG. 3 for #1 decoder 22. 

Extrinsic information L ie f rom this decoder 22 in FIG. 3 for k=l is 
calculated in 2 in equations 9 using the soft outputs 
{y(k,b=l)} 20 of the received channel for the systematic bit b=l 
which is the uncoded bit, the subset of the detected output 

12 



symbols 19 which are from #1 decoder 3 in FIG. 1, and the #1 
decoder likelihood ratio output Li calculated from 4 in equations 
8. The a-priori information on p(d(k)) in 4 in equations (8) 
from #2 decoder 25 is not available so we set p(d(k))=0 
corresponding to p (d ( k) =+1 ) =p (d ( k) =-1 ) = ^. 

MAP turbo decoding iterative algorithm (9) 

1 Definitions 

L m = { L(d(k=l) |y) ) , k=l,2,....} for m=#l,#2 decoders 

= a-posteriori likelihood ratio 
L me = { L me (d(k=l) |y) ) , k=l,2,....} 

= extrinsic information from m=#l,#2 decoder 
= a-priori estimates of In [p (d=+l ) /p (d=-l ) ] 
which defines p for the other decoder using 
equations 10 to solve for p 

L lc = Interleaved L ie 

^2e ' L 2 = De-interleaved L 2e / L2 

y(k,b=l) = y for uncoded bit b=l 

y (k,b=l) = interleaved y for uncoded bit b=l 

2 Iteration k=l starts the turbo decoding 

Lie = la - 0 - (2/a 2 )Re[y (k,b=l) ] 
L 2e = L 2 - L le - (2/a 2 )Re[y (k / b=l) ] 

where Re(o) = Real(o) 

3 For iteration k=2,3,... 

L le = Li - L 2e - (2/a 2 )Re[y(k,b=l) ] 

L 2e = L 2 - L le - (2/a 2 )Re[y (k,b=l) } 

4 Decode after last iteration 

Decide d (k) -+1/-1 = 1/0 bit value 

for L 2 (d(k) |y)>/<0 for k=l,2,. . . 
where d (k) is the estimate of d(k) from turbo decoding 
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Step 2 next proceeds to #2 decoder 25. A-priori estimates 
for p(d(k)) are calculated from the extrinsic information from #1 
decoder after interleaving 23 in FIG. 3 in order to align the 
bits with the interleaved bits 4 in FIG. 1 which are encoded by 
the #2 encoder 5. Calculation of the a-priori p for #1,#2 
decoder using the extrinsic information from #2,#1 decoder is 
given in equations (10) from references [2] ,[4]. Inputs to the 

A-priori calculation of £ in 4 in equations 8 (10) 

K = [1+ exp(L me )] 

p(d(k)= -1) = -ln(K) 

p(d(k) = +1) = L me -ln(K) 

#2 decoder 25 in FIG. 3 are the detected output symbols 19 from 
the #2 encoder 5 in FIG. 1, the detected symbols for the 
systematic bits 21 after interleaving 24, and the extrinsic 
information from #1 decoder 22 after interleaving 23. 
Calculation of the extrinsic information L 2e from #2 decoder is 
given in 2 in equations (9) . 

Step 3 repeats step 2 with the addition of the de- 
interleaved 26 extrinsic information input L 2e to #1 decoder 22 

from #2 decoder 25. This L 2e is used to calculate the a-priori 

probabilities p using equations (10) for use in the evaluation of 
the a-posterior likelihood ratio Li from decoder #1, and also 
used in the calculation of the extrinsic information L ie for 
decoer #1 in 3 in equations (9) . 

Step 4 is the calculation of the estimates {d(k)} for the 
transmitted information {d(k)} in the form of + /-1 used in the 
iterative algorithm to model the BPSK modulation with values +/-1 

for the estimated input signal {d(k)} in 28 with +1 
corresponding to the bit value 1 and -1 for the bit value 0. The 
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de-interleaved 27 a-posteriori maximum likelihood ratio L 2 from 
#2 decoder in FIG. 3 yields these output bits 28 using the hard 

decisioning rule that decides 1/0 depending on whether the L 2 is 
>0 or <0. 

5 Convolutional decoding will be discussed in the disclosure 

of the new invention. 

FIG. 4 is a representative demodulation receiver block 
diagram for implementation of the turbo decoder in FIG. 3 and the 
convolutional decoder in FIG. 8, which emphasizes the 

10 demodulation processing for both single and multiple channels. 
The signal processing starts with the user transmitted wavefronts 
29 incident at the receiver antenna for the n u users u =1,..., n u < 
N c . These wavefronts are combined by addition in the antenna to 
form the receive Rx signal v(t) at the antenna output 30 where 

15 v(t) is an estimate of the transmitted signal v(t) 17 in FIG. 
2, that is received with errors in time At, frequency Af, phase 
A9, and with an estimate z(t) of the transmitted complex baseband 
signal z(t) 14 in FIG. 2. This received signal v(t) is 

amplified and downconverted by the analog front end 31 and then 

20 synchronized and analog-to-digital ADC converted 32. Outputs 
from the ADC are handed over to the multiple access channel 
recovery signal processing 33 and the demodulation processing 
34 where the waveform is removed to recover the symbols 35. These 
detected symbols 35 are turbo/convolutional decoded 36 to 

25 recover estimates { d(k) } of the received data which are processed 
by the frame processor 37 to recover estimates 38 of the 
transmitted user data words. The serial processing for the 
multiple access channel recovery and the demodulator is combined 
for several of the multiple access schemes and for the 

30 demodulation such as GMSK. As noted in the discussion for FIG. 2, 
the frame processing can be before and/or after the turbo 
decoder. 
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It should be obvious to anyone skilled in the 
communications art that this example implementation clearly 
defines the fundamental current turbo and convolutional encoding 
and decoding signal processing relevant to this invention 
disclosure and it is obvious that this example is representative 
of the other possible signal processing approaches. 

For cellular applications the transmitter description 
describes the turbo and convolutional encoding transmission 
signal processing applicable to this invention for both the hub 
and user terminals, and the receiver describes the corresponding 
turbo and convolutional decoding receiving signal processing for 
the hub and user terminals for applicability to this invention. 

For optical communications applications the microwave 
processing at the front end of both the transmitter and the 
receiver is replaced by the optical processing which performs the 
complex modulation for the optical laser transmission in the 
transmitter and which performs the optical laser receiving 
function of the microwave processing to recover the complex 
baseband received signal with the remainder of the signal 
processing functionally the same as described in FIG. 2 for the 
turbo and convolutional encoding transmitter and in FIG. 4 for 
the turbo and convolutional decoding receiver. 

SUMMARY OF INVENTION 

This invention introduces the new decisioning metrics in 
this invention for turbo decoding and convolutional decoding, 
the new MAP joint probability for turbo decoding, the new 
formulation to replace the ML probability for convolutional 
decoding, and the corresponding new estimators that replace the 
current recursive estimators a k _i,p k , and the new replacement 
for the state transition probability y k used for both 
convolutional and turbo decoding. It will be apparent to the 
reader that these probability equations together with the 
decisioning metrics provide new mathematical paridyms for the 
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•decoding algorithms, and offer an improvement in BER performance, 
rate of convergence for turbo decoding, and lower implementation 
complexities . 

The MAP joint probability for turbo decoding is p(s,s',y) 
5 defined in 3 in equations (2), where s,s' are the decoding 
states for symbol sets k,k-l respectively and y is the complete 
set of observed symbol sets for k=l,2,...,N. The current 
practice uses the p(s,s',y) in the MAP equations (8) wherein the 
MAP a-posteriori log likelihood ratio L(d(k)|y) in 3 in equations 

10 (8) reduces to the natural log of the ratio of the sum of 
p(s,s',y) over s,s' for d(k)=+l, to the ratio of the sum of 
p(s,s',y) over s,s' for d(k)=-l. 

The MAP joint probability p(s,s',y) was formulated to 
support the use of the maximum likelihood ML probability f(y|x) 

15 in 1 in equations (1) and the corresponding log form of the ML 
decisioning metric DM in 3 in equations (1), and to support the 
factoring into the product of the estimators a k -i,p k ,y k in 4 in 
equations (3) . This factoring in log form in 4 in equations (8) 
is equal to the sum of the log forms of these estimators a k _ 

20 i,Qk,Xk which are used for all of the turbo decoding algorithms, 
as well as for the covolutional decoding algorithms upon deleting 
the a-priori p in y k in 6 in equations (6), 

The ML probability density function or likelihood ratio is 
f(y|x) in equations (1). ML maximizes f(y|x) with respect to x in 

25 order to find the best x which is equivalent to maximizing the 
decisioning metric DM in 3 in equations (1) equal to DM=- | y- 
x| 2 /2a 2 with respect to x where I y-x | is the geometric distance 
between x and y. This DM in 3 in equations (1) is the natural log 
of f(y|x) with the additive constants removed. Maximizing DM is 

30 equivalent to minimizing I y-x | and therefore selects the x which 
is closest to y as the ML choice for x. ML decisioning metric DM 
is used to make the bit decisions in turbo decoding as 
demonstrated in equations (7), (8), (9), and is used to select the 
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best trellis paths in convolutional decoding as will be 
demonstrated in the disclosure of this invention. 

Our new MAP probability p(s,s'|y) is the a-posteriori 
probability of s,s' given the observations y. This is the 
5 correct formulation for the MAP probability from a probability 
theorectic viewpoint Ref. [8], and is made possible by our use 
of the a-posteriori probability f (x|y) for the probability of the 
transmitted symbol x given the observed symbol y, in place of 
the likelihood ratio f(y|x) in equations (1). It will be 

10 demonstrated that by using our new MX decisioning metric DX, 
the p(s,s' |y) in log form can be factored into the sum of the our 
new recursive estimators which replace the a k -i,{3 k and our new 
state transition probability p k that replaces currently used 
for all of the turbo decoding algorithms, 

15 The new maximum a-posterior MX replaces the maximum 

likelihood ML, and maximizes the a-posteriori probability densify 
function f(x|y) of x conditioned on the observation y, with 
respect to the selection of x. Maximizing f(x|y) is equivalent 
to maximizing with respect to x, the natural log of f(x|y) equal 

20 to the new decisioning metric DX=Re (yx* ) /a 2 - | x | 2 /2a 2 plus the 
natural logarithm In [f (x) =p (x) =p (d) of the a-priori probability 
f (x) =p (x) =p (d) upon deleting the additive constants. In the DX 
equation, the Re(o) is the real part of (o) and x* is the 
complex conjugate of x. MX and its decisioning metric DX select 

25 the x which is closest to y as the MX choice for x, even though 
the equations for DX are linear in y compared to the quadratic 
dependency on y for DM. In the disclosure of this invention it 
will be demonstrated that the MX decisioning metric DX can be 
used to make the bit decisions in turbo decoding and can be used 

30 to select the best trellis paths in convolutional decoding. It 
will be proven that the MX is equivalent to ML and that 
maximizing DX is equivalent to maximizing DM for decisioning, 
with an added improvement in BER performance using DX. 
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Without any mathematical analysis, it should be apparent 
that DX has less noise compared to DM since DX is linear in y 
whereas DM involves the square of the vector y. This lower 
noise level translates into an improved decisioning performance 
5 of DX compared to DM. Also, it is apparent that the 

calculations for DM use more multiply and addition operations 
than DX, which means the DX should have a lower implementation 
complexity. 

10 BRIEF DESCRIPTION OF DRAWINGS 

The above-mentioned and other features, objects, design 
algorithms, and performance advantages of the present invention 
will become more apparent from the detailed description set forth 
below when taken in conjunction with the drawings wherein like 
15 reference characters and numerals denote like elements, and in 
which: 

FIG. 1 is a representative block diagram of the 
implementation of a turbo encoder using a parallel architecture. 
Input user bits are {d(k)}. The code is a recursive systematic 

20 code RSC with the first bit of each codeword assigned to the 
systematic bit which are the uncoded user data bits, part of the 
remainding set of bits in the codeword are the #1 encoder output, 
and the rest of the bits within the codeword are the # 2 encoder 
output. User input bits {d(k)} are interleaved prior to handoff 

25 to the #2 encoder to make the #2 encoder output almost 
statistically independent of the # 1 encoder output in order to 
support the iterative convergence of the turbo decoding. A 
convolutional encoder uses either #1 encoder or the interleaved 
#2 encoder. Output codewords for codeword k=l,2,. . .,N are the 

30 set c (k) ={c (k,b) } of bits {b} of codeword k corresponding to the 
input data bits {d(k)}. 

FIG. 2 is a representative implementation block diagram 
for the turbo encoder and the convolutional encoder transmitter 
with the signal processing elements relevant to turbo and 

35 convolutional encoding, signal generation, and transmission. 



Turbo/convolutional encoder output codewords {c(k)} are 
formatted, symbol encoded {x(k)}, waveform modulated, multiple 
access encoded, digital-to-analog converted by a DAC, single 
sideband upconverted SSB to an intermediate frequnency IF, 
5 upconverted to a transmission or radio frequency RF, handed off 
to the antenna, and transmitted. 

FIG. 3 is a representative block diagram of the 
implementation of a turbo decoder using a parallel architecture. 
The code is a recursive systematic code RSC with the first bits 
10 of each codeword the systematic bits, a subset of the remaining 
bits are the #1 encoder output, and the other subset of the 
codeword are the # 2 encoder output for the interleaved bits. In 
each iteration the #1 decoder generates the output a-posteriori 
likelihood ratio Li in equations (9) using as a-priori estimates 

15 of p the de-interleaved extrinsic information L 2e from the #2 

decoder output. The #1 decoder calculates its extrinsic 
information Li e for use by the #2 decoder, using 3 in equations 
(9) . The #2 decoder then performs the corresponding set of 
operations to calculate the L 2e for use by the #1 decoder in the 

20 next iteration. When the stopping rule is activated, the #2 
decoder output L 2 is de-interleaved and used to decide the 
estimates for the turbo decoded user bits with the detection rule 
4 in equations (9) . 

FIG. 4 is a representative implementation block diagram 

25 for the turbo decoder and convolutional decoder receiver with the 
signal processing elements relevant to signal reception and 
processing, symbol recovery, and turbo/convolutional decoding. 
The received waveform from one or multiple users 29,30 is 
received and down-converted 31 to an IF, synchronized in time and 

30 frequency and analog-to-digital converted ADC 32. Complex 
outputs are stripped of their multiple access 33 and the output 
symbols are detected 34. Detected symbols {y(k)} 35 are handed 
to the turbo decoder. Turbo decoded output estimates of the 
received data are de-formated and error detected 37 to recover 
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estimates { d(k) } of the transmitted data {d(k)} 38. Throughout 
this patent the impact of the formatting and de-formatting has 
been neglected as is general practices which means that the 

estimates { d(k) } are assumed to be the turbo decoder outputs. 
5 FIG. 5 plots the Monte Carlo simulation of the decisioning 

metric performance for the MX decisioning metric DX=ln [ f (x | y ) ] 
and the ML decisioning metric DM=ln [ f (y | x) ] against the symbol y 
signal-to-noise power ratio S/N. The equation DX=ln [f (x | y) ] takes 
into account that the a-priori probability p(x)=f(x) factor is 

10 deleted and the additive constants deleted. Likewise, 
DM=ln (f {y | x) ] assumes the additive constants are deleted and has 
no means for including the effects of the a-priori probability 
p(x). Decisioning metric performance in the log domain is the 
difference between the correct and incorrect BPSK assumption for 

15 x. 

FIG. 6 plots the improvement in S/N against the symbol y 
S/N. This improvement is the advantage in S/N from using our 
MX decisioning metric in FIG. 5 compared to the current ML, for a 
given level of the decisioning metric performance in FIG. 5. 

20 

DISCLOSURE OF INVENTION 

The new invention provides new decisioning metrics and new 
probabilities and new equations for the turbo decoding and 
convolutional decoding, which together provide performance 

25 improvements and reduce the decoder implementation complexities 
for all decoding architectures. In this invention disclosure, the 
new decisioning metric will be derived and evaluated prior to the 
derivation of the new probability equations and algorithm 
examples for the new decoding architectures for turbo and 

30 convolutional codes. 

Our MX a-posteriori probability f(x|y) defines the 
decisioning metric DX for turbo and convolutional decoding, where 
f (x|y) is the conditional probability of the transmitted symbol x 
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at clock k for the received codeword k, given the received 
symbol y. The DX is derived from the MX in equations (11) . Step 1 



MX decisioning metric DX (11) 

5 1 Bayes rule f (a,b) =f (a | b) f (b) =f (b I a) f (a) enables 

the MX f (x|y) to be defined 
f(x|y) = f (y|x)f (x)/f (y) 
2 The Gaussian conditional probability f (y|x) is 
f(y|x) = ( (27t) 1/2 a)' 1 exp(-|y-x| 2 /2a 2 ) 
10 3 The Gaussian probability f (y) is 

f(y) = ( (2tt) 1/2 a)" 1 exp(-|y| 2 /2a 2 ) 

4 Equations 2,3 yield the result for MX 

f(x|y) = f(x) exp(Re(yx*) /a 2 -|x| 2 /2c 2 ) / (2n) 1/2 a 

5 Taking the natural log and deleting 
15 the additive constant yields for MX 

ln[f(x|y)]= Re (yx*) /a 2 -|x| 2 /2a 2 + ln[f(x)] 

6 This MX equation reduces to 

ln[f(x|y)]= Re(yx*) /a 2 -|x| 2 /2a 2 + ln[p(d]) 
= DX + p(d) 

20 where DX = Re (yx* ) /a 2 - | x 1 2 /2a 2 

x* = complex conjugate of x 
P(d) = f(x) 
p(d) = ln[p(d)] 

25 uses the Bayes rule to derive f (x | y) =f (y | x) f (x) /f (y) . Step 2 
defines f(y|x) as the conditional Gaussian probability density 
function. Step 3 defines f(y) as the Gaussian probability 
density function. Step 4 derives the MX f(x|y) from the f(y|x) 
in 2 by dividing by the f (y) in 3. Step 5 defines the natural 

30 log of the MX a-posteriori probability ln[f(x|y)] after the 
additive constant has been deleted. Step 6 re-writes the MX 
ln[f(x|y)] in 5 as the sum of our new decisioning metric DX and 
the log p(d) of the a-priori probability p(d)=f (x) of the data d 
corresponding to x. 
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FIG. 5 plots the Monte Carlo simulation decisioning 
performance 39 of our MX decisioning metric ln[f(x|y)] 41 and 
the ML decisioning matric ln[f(y|x)] 42 against the symbol y 
signal-to-noise power ratio S/N 40. The equation DX=ln [f (x | y) ] 
5 takes into account that the a-priori probability p(x)=f(x) factor 
is deleted and the additive constants are deleted. Likewise, 
DM=ln (f {y | x) ] assumes the additive constants are deleted. 
Decisioning metric performance 39 in the log domain is the 
difference between the correct and incorrect BPSK assumption for 

10 x. For the MX DX, the simulated performance metric is equal to 
In [<f (x | y) >/<f (x' | y) >] where <(o)> is the Monte Carlo statistical 
average over 100K trials of (o) , the f(x|y) is the correct 
decision for BPSK modulation, and f(x'|y) is the incorrect 
decision. The performance metric for the ML DM is the same 

15 ln[<f (y|x}/f (y|x' )>. It is apparent from the data 41,42 that the 
required S/N to support a given level for the DX metric is 
considerably less than required for the DM metric. This directly 
translates into an improved BER performance. 

FIG. 6 plots the improvement in S/N 43 against the symbol y 

20 S/N 44 This improvement 45 in S/N from using our MX 
decisioning metric in FIG. 5 compared to the current ML, is the 
increase in S/N required for the ML metric to equal the value 
measured for the MX metric. Over the range of S/N of interest 
which is 0 to 10 dB, there is a -1.7 dB improvement in S/N which 

25 is significant and clearly translates into an improvement in BER. 
There are no other available means to offer this improvement for 
both turbo and convolutional decoding. 

The new probability density p(s,s'|y) for MAP turbo is 
written as a function of the independent observations {y(j<k), 

30 y(k), y(j>k)} in equations (12) using 1,2 in equations (2). 

New MAP probability (12) 

p(s,s'|y) = p(s,s'| y(j<k), y(k) y(j>k) ) 
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Recursive equation for p(s,s'|y) is derived in equations 
(13) following the steps in equations (3) for the p(s,s',y) 
recursive equations. Step 1 is the application of Bayes rule to 
partition the probability p(s,s'|y). Step 2 takes advantage of 
5 the assumption that the channel is memoryless to simplify the 

Recursive formulation of p(s,s' |y) (13) 

1 Bayes rule p (a , b) =p (a | b) p (b) can be used to 
rewrite the p(s,s'|y) in equation (12) 

10 p(s,s'|y) =p(s,s'| y(j<k),y(k),y(j>k)) 

= p(s|s' ,y(j<k) ,y(k) ,y(j>k) ) 
*p(s' |y(j<k) ,y(k) ,y(j>k) ) 
where is a multiply operation 

2 Assuming the channel is memoryless 

15 p(s,s'|y) = p(s|s',y(k),y(j>k)) p (s' I y (j<k) ■ 

3 The events {s' , y (k) } , {y ( j>k) } are independent 
since the channel is memoryless, so we can 
factor 2 into 

p(s,s' |y)=p(s|s' ,y (k) )p(s|y(j>k) )p(s' |y(j<k) ) 
20 4 This equation can be rewritten as a function of the 

recursive estimators and state transition probability 

p (s,s' ,y)= p k (s I s' ) b k (s) a k _i(s') 
where by definition 

Pk(s|s' ) = p(s|s' ,y(k) ) 
25 b k (s) = p(s|y(j>k)) 

a k -i(s') = p(s' |y(j<k)) 
partitioning in step 1. Step 3 applies the identity 

p(a|b,c)=p(a|b)p(a|c) which is true when events b,c are 
independent p (b, c) =p (b) p (c) , to re-partition the first factor 
30 into the product of two factors. Step 4 transforms the joint 
probability in step 3 derived as a product of three 
probabilities, into the equivalent product of the two new state 
estimators a k _i(s' ) ,b k (s) and the state transition probability 
Pk(s|s') for the new MAP turbo decoding algorithm. The p k (s|s') 
35 calculates p(s|s',y(k)) for each state transition assumption 



s->s' for symbol set k. These estimators a k (s) , b k (s), p k (s|s')/ 
are part of this invention disclosure and are clearly distinct 
from the current set of estimators a k i (s' ) , p k (s) , y k (s,s') in 4 in 
equations (3) . 

5 Forward recursive equation for a k (s) is derived in equations 

(14) as a forward recursion which is a function of the p k (s|s') 
and the previous state estimate a k -i(s'). Step 1 starts with the 
definition of a k (s) which is derived from the equation for 
a k _i(s' ) in 4 in equations (13). In step 2 we introduce the state 
10 s' by observing the probability summed over all values of s' is 
equal to the probability with s' excluded. In step 3 we apply 
Bayes rule to partition the probabilities. In step 4 the 
assumption that the channel is memoryless enables the equation to 
be simplified to the form used in the MAP algorithm. In step 5, 

15 

Forward recursive equation for a k (s) (14) 

1 From the definition for a k -i(s') in 4 in equations 
(13) we find 

a k (s) = p(s|y(j<k),y(k)) 
20 2 This probability can be written as the sum of 

joint probabilities over all possible states of s' 
a k (s) = Zaii s' P(s,s' |y (j<k) ,y (k) ) 
3 Applying Bayes rule 

a k (s) = Eaiis- p(s|s',y(j<k),y(k)) p (s' I y ( j<k) , y (k) ) 
25 4 Applying the channel memoryless assumption 

a k (s) = Zaii s' p(s|s',y(k)) p(s'|y(j<k)) 
5 Substituting the definitions of p k (s | s' , y (k) ) and 
a k _i(s') from 4 in equations (13) 

a k (s) = Zaii S ' p k (s|s') a k _!(s f ) 

30 

substitution of p k (s | s' , p (k) ) and a k _i(s') from 4 in equations 
(13) gives the final form for the recursive equation for a k (s). 

Backward recursive equation for b k _i(s') is derived as a 
backward recursion in equations (15) as a function of the 
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Pk(s' I s) =p (s' Is) and the previous estimate b k (s), following the 
steps in equations (14). Step 1 derives b k -i(s') from the 
equation for b k (s) in 4 in equations (13) . Step 2 is similar to 
steps 2,3,4 in equations (14). In step 3, using the equality 

5 

Backward recursion equation for b k -i(s') (15) 

1 The definition for b k (s) from 4 in equations (13) 

b k -i(s' ) = p(s' |y(j>k-l) 

2 Similar to the steps 2,3,4 in equations (4), we find 

10 b k -!(s') = I all s p(s|y(j>k) )p(s' |s,y(k) ) 

3 Substituting the definitions of b k (s) from 4 
in equations (13) 

b k -i(s') =Zaiisb k (s) p k (s / |s) 

15 p (s' I s, y (k) ) =p (s | s' , y (k) which is equivalent to the equality 
p k (s'|s)= p k (s|s') and substitution of p k (s|s') from 4 in 
equations (13) gives the final form for the recursive equation 
for bk-i(s'). The equality p k (s'|s) = p(s|s') simply recognizes 
that they are defined by the same MX equations as well as the 

20 same decisioning metric DX. 

Log of the state transition probabilities £ k (s | s' ) =£ k (s' | s) 
are derived in equations (16). The p k (s|s') is the probability 
of the decoder trellis state S(k-l)=s' transitioning to the next 
state S(k)=s given the observation y(k). For the backward 

25 recursion, the p k (s'|s) is the probability of the decoder 
trellis state S(k)=s transitioning from the previous state S(k- 
l)=s' given the observation y(k). In step 1 we rewrite the 
definition of p k (s|s') in 4 in equations (13) as the probability 
of the state transition s'->s given the observation y(k). Step 2 

30 rewrites 1 as the equivalent probability of the transmitted 
symbol x(k) corresponding to the transition s'->s. Step 3 are 
definitions similar to 2 in equations (6) . Step 4 expands the 
equations in 2 into a product over the codeword bits for the #1 
and #2 encoders 3 and 5 respectively in FIG. 1, of the 
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State transition probabilities p k (s | s' ) = Pk(s' | s) (16) 

1 The Pk(sls') is defined in 4 in equations (13) 

p k (s|s') = p(s|s',y(k)) 
5 = p(s'-»s|y(k) ) 

2 Since the transition s'->s is defined by x(k) 

p k (s|s' ) = p(x(k) |y(k) ) 

3 We introduce the definitions 2 in equations (6) 
with the properties 

10 d(k) = input data corresponding to x(k) 

p(d(k)) = p(x(k)), = a-priori probability of d(k) 
x(k) = {x(k,b)), b refers to the codeword bits 
y(k) = {y(k,b)}, b refers to the codeword bits 

4 These definitions and the memoryless assumption, enable 
15 equations 2 to be expanded 

p k (s|s') = p(x(k) |y(k)} 

= Fib P(x(k,b) ly(k,b)) 

5 From 4 in equations (11) and the identity p (x | y) =f (x | y) 

p k (s|s')= Fib [ (2ti) 1/2 a)" 1 exp(DX(k,b) ) p(d(k)) 
20 6 MX decision metrics DX(k,b), DX (s | s' ) =DX (s' I s) are 

from 6 in equations (11) 
DX(s|s' ) = Z b DX(k,b) 

= Z b Re[y(k / b)x*(k,b)]/a 2 -|x(k,b) | 2 /2a 2 
= DM ( s ' | S ) 

25 7 Log equations for £k(s | s' ) =E>k(s' | s) are the log of 5 

using 6 and deleting the additive constants 
p k (s|s' ) = DX(s|s' ) + p(d(k) ) 
= DX(s' is) + p(d(k) ) 
= Pk ( s ' Is) 

30 probabilities for each bit p (x (k,b) | y (k, b) ) . In step 5 we 
introduce the standard turbo code assumption that the channel is 
Gaussian and uses BPSK (Binary phase shift keying) symbols which 
means d(k)=+/-l identical to the starting assumptions for 
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equations (11), with a equal to the one sigma Gaussian noise 
along the inphase and quadrature axes. 

In step 6 we generalize the MX decisioning metric DX in 6 
in equations (11) for p (x | y) =f (x | y ) , to DX(k,b) for 
5 p(x(k,b) |y(k,b) )=f (x(k,b) |y (k,b) ) , and to DX (s | s' ) =DX (s' I s) equal 
to the sum of the DX(k,b) over all s~>s' and s'->s transitions 
respectively, which is the sum over all bits {b} for clock k 
equal to codeword k. Step 7 takes the log of 5 and deletes the 
additive constants to give the log equations for the state 

10 transition probabilities p k ( s | s' ) =p k ( s' I s ) as linear sums of the 
DX (s | s' ) , DX (s f | s) and the log of the a-priori data probability 
p(d(k)). The p k (s | s' ) = p k (s' ] s) will be used in turbo decoding 
algorithms, and in convolutional decoding algorithms when the log 
a-priori probability p(d(k)) is deleted. 

15 Log equations for a k (s) , baits') are derived in equations 

(17) from equations (14), (15) respectively for a k (s), b k _i(s') 
using the definition of p k (s|s') in 7 in equations (16). Step 1 
gives the log equation for a k (s) by taking the log of the a k (s) 

20 Log equations for a k (s) , b k _i(s') (17) 

1 Log a k (s) 

a k (s) = ln[ Zaii S 'exp(a k -!(s' )+DX(s|s' )+ p(d(k))] 

2 Log b k -i(s') 

b k -!(s' )=ln[ Zaii s exp (b k (s)+DX(s' |s)+ p(d(k) ) ] 

25 

equation in 5 in equations (14) and using the definition of 
p k (s|s') in 7 in equations (16). Step 2 takes the log of the 
equation for b k _i(s') in 3 in equations (15) to derive the log 
equation for bfc-ifs') and uses the definition for p k (s|s') in 7 in 
30 equations (16) . 

Our new MAP equations for the log likelihood ratio 
L(d(k)|y)) are derived in equations (18). Step 1 is the definiton 
from references [1],[2]. Step 2 replaces p(d(k)) with the 
equivalent sum of the probabilities that the transition from 

28 



S(k-l)=s' to S(k)=s occurs and which are our new probabilities 
p(s,s'|y) over these transitions. Step 3 substitutes the log 
of the recursive estimators a k _i (s' ) ,b k (s) , from 1,2 in 
equations (17) and the p k (s|s') from 7 in equations (16). Step 4 

5 

Our new MAP equations (18) 

1 Definition 

L(d(k) ) |y) = ln[p(d(k)=+l|y) ] 
-ln[p(d(k)=-l|y) ] 
10 2 Probability of p(d(k)) is the sum of the probabilities 

that the state S(k-l)=s' transitions to S(k)=s 
L(d(k))|y) = ln[ Z (s ,s' id< k )- + u p(s,s'|y)] 
-ln[ E (s ,s'id(k)=-i) p(s,s'|y) ] 

3 Our new MAP equation is obtained by substituting the 
15 a k -i(s'),b k (s), p k {s|s') 

L(d(k))|y) = ln[ Z (s , s . idoo= + i) p(s,s'|y)] 
-ln[ E <S/ s'id(k)=-i) P(s,s' |y) ] 

20 = ln[I (s , sMd{k)=+1) exp(a k _i(s' )+DX(s|s' )+p(d(k) )+b k (s) ) ] 

-ln[2 (SfS .| d(k ,.-i, exp(a k _i(s' )+DX(s|s' ) +p (d (k) ) +b k ( s) ) ] 

4 Hard decisioning 

d(k) - +1/-1 when L(d(k)|y) > 0 / < 0 
25 5 Soft decision metric = L(d(k)) |y) 

gives the hard decisioning rule. Step 5 identifies L(d(k)|y) to 
be the soft decisioning metric. 

FIG. 1 describing a representative turbo encoding block 
30 diagram for a parallel architecture and FIG. 2 describing a 
representative implementation block diagram of a turbo encoder 
and transmitter, apply to our invention since we are not 
addressing any changes to the encoding. 
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Fig. 3 describing a representative turbo decoding block 
diagram and FIG. 4 describing a representative receiver block 
diagram for a turbo decoder receiver, apply to our invention 
when the turbo decoding signal flow diagram in FIG. 3 implements 
5 the MAP iterative algorithm in equations (9) using our likelihood 
ratios in equations (18) . Our decisioning metric performance 
advantage of -1.7 dB in FIG. 5,6 will support a BER improvement 
in the MAP algorithm (9) . 

Convolutional decoding starts with the assumptions that we 

10 are decoding a sequence of observed channel output symbols 
{y(k), k=l,2,...,N} of the receiver where "k" is the running index 
over the N transmitted symbols. Each set y(k) of symbols at 
clock k consists of the observed uncoded and coded symbols for 
the received codeword k at clock k. These are the same starting 

15 set of assumptions used for turbo decoding. 

FIG. 7 is a representative convolutional encoder block 
diagram. Input 46 to the encoder are the user data bits {d(k)} 
for k=l,2,. . . , N . 1 The encoder for a convolutional code uses a 
recursive systematic code RSC or a systematic code SC which means 

20 the first codeword bit 47 is the user data bit called systematic 
bit, or bits, which are uncoded. These user data bits {d(k)} 
are also handed over to the encoder 48 followed by interleaving 
49. Output bits 50 are punctured to obtain the correct code 
rate and multiplexed 51 into a continuous output bit stream 52 of 

25 codewords {c(k)} for each of the codeword clocks k=l,2, Each 

codeword c(k) 52 is a set of bits consisting of the systematic 
bits followed by the encoder and interleaver output bits 52. 

FIG. 8 is a representative convolutional decoder block 
diagram. Inputs are the detected soft output symbols 53 from 

30 the received channel demodulator which detects and recovers these 
symbols. This stream of output symbols consists of the outputs 
for the systematic bit b=l and the outputs from the interleaved 
and encoded bits. Following de-interleaving 54 the convolutional 
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decoder recovers estimates {d(k)} of the user input bits {d(k)} 
to the convolutional encoder. 

Convolutional decoding similar to the Viterbi algorithm, 
solves the recursive equations [Ref. 2,3,5] derived from 
5 equations (7) by replacing the summations over all possible 
transitions with the best transition path to each of the new 
trellis states. The best transition path for convolutional 
decoding is the best choice of s' for each forward path s'-^s and 
the best choice of s for each backward path s->s' , where best is 
10 the maximum value of the state metric for the path transitions. 

For the forward recursion the log ML equations are derived 
in equations (19) using the redefined state path metric a k (s) 
and the state transition decisioning function DM. Step 1 is the 

Forward equations for ML convolutional decoding (19) 

1 The ML probability density has the well-known 
factorization assuming a memoryless channel 

p (y (k) | s) = rij=i,...,k-i P (y ( j ) I Sj-i -^Sj) 

= p(y(k) |s'-»s) p(y(k-l) Is') 

2 State path metric a k (s) in log format is 
a k (s) = p (y (k) |s) 

3 Forward equations for a k (s) are derived using 2 
and the log of 1. We find 

a k (s) = max [p (y (k-1) | s' ) + p (y (k) | s' -*s) ] 

s' 

= max [a k _i(s') + DM (sis')] 

DM(s|s' ) = p(y(k) Is'^s) ] 

= -|y(k)-x(k) \ 2 /2a 2 

factorization of the ML probability that is allowed by the 
30 memoryless channel assumption. Step 2 is the definition of the 

path metric a k (s) in log format which is different from its 
definition in 1 in equations (4) for MAP turbo decoding. Step 3 
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derives the forward recursive equation for a k (s) by combining the 
equations in 1 and 2 and using the definition of the ML 
decisioning metric DM=ln [p (y (k) | s' ->s) ] = p (y (k) | s' ->s) ] for the 
path s'^s for convolutional decoding. Path metrics and the 
5 corresponding data d(k) bit for each trellis state are stored in 
a state matrix. The best path corresponding to decoding state k 
is used to select the best data d(k-D) bit decision at the state 
k-D of this path stored in the state matrix, where D is a delay 
in the data bit decisioning that is required for reliable 
10 decoding . 

For the backward recursion the log ML equations are derived 
in equations (20) using the state path metric j3 k (s) in 2 in 

equations (7) , and the state transition probability Xk(s,s f ) and 
decisioning metric DM(s|s') from 4,5,6 in equations (6). Step 1 

15 

Backward equations for ML convolutional decoding (20) 

1 State path metric |3 k -i(s') in log format is equal 
to the value 1 in equation (5) 

fie-i(s') = ln[p(y(j>k-l)s' ) ] 

20 = p(y(j>k-l) Is' ) ] 

2 Backward equations for gk-i(s') are derived using 1 
and the 2,3 in equations (5). We find 

fiic-i(s') = max [p(y(j>k) |s) + p (s,y (k) | s' ) ] 

s 

= max [J3 k (s) + DM(s|s' ) ] 

s 

25 DM(s'ls) = -|y (k)-x(k) | 2 /2a 2 

is the definition of 0k-i(s f ) in 1 in equations (5). Step 2 
modifies the derivation of 13 k -i(s') in equations (5) and the final 
equation for J3k-i(s') in 2 in equations (7) to derive the J3 k -i(s') 
for the backward convolutional decoding, with the modifications 

30 being 1) setting the a-priori probability p(d(k)=0 since there 
is no a-priori probability available, and 2) replacing the 
summation over all s with the maximum with respect to s of [j3 k (s) 
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+ DM(s|s')]. Path metrics and the corresponding data d(k) bit for 
each trellis state are stored in a state matrix. The best path 
corresponding to decoding state k is used to select the best data 
d(k+D) bit decision at the state k+D of this path stored in the 
state matrix, where D is a delay in the data bit decisioning 
that is required for reliable decoding. 

Our new convolutional decoding equations (21) for forward 
and backward recursions are modifications of the previously 
derived MAP equations for a k (s) in equations (14), b k _i(s') in 
equations (15), DX (s | s' ) =DX (s' I s) in equations (16), and the 
final equations for a k (s), b k _i(s') in 1,2 in equations (17). 
Modifications consist of 1) setting p(d(k))=0 since there is no 
a-priori information on p(d(k)), and 2) replacing the summation 
over all s',s with the maximum of [a k -i (s' ) +DX (s | s' ) ] , 
[b k (s) +DX (s' Is)] respectively with respect to the path transition 
s' -^s , s->s' respectively . 

Our new convolutional decoding equations (21) 

1 Definition of a k (s) from 1 in equations (14) 
a k (s) = p(s|y(j<k) 

2 Forward recursion for a k (s) can be derived by 
modifying the derivation of a k (s) for the MAP 
turbo decoding. We find 

a k (s) = max [a k _i (s' ) + DX(s|s')] 

DX(s|s')] = Re[y(k)x*(k)]/a 2 -|x(k) | 2 /2a 2 

3 Definition of b k -i(s') from 1 in equations (15) 

b k -!(s' ) = p(s' |y (j>k-l) ) 

4 Backward recursion for b^-iCs') can be derived by 
modifying the derivation of b k - i (s / ) for the MAP 
turbo decoding. We find 

b k _i(s') = max[b k (s)+ DX(s'|s)] 

s 

DX(s' |s) ] = Re[y(k)x*(k) ] /a 2 -|x(k) | 2 /2a 2 
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Step 1 for our new forward recursion uses the same 
definition of a k (s) for the MAP turbo decoding in 1 in equations 
(14) with the modification that the a-priori probability 
p (x (k) ) =p (d (k) ) =0 corresponding to setting the probability 
5 p(d(k)=+l)=p(d(k)=-l)=l/2. Step 2 then follows the steps in 
equations (14), (16) leading to the equations 1 in equations (17) 
for a k (s) for the MAP turbo decoding, upon replacing the 
summation over s' with the maximization with respect to s' 
similar to the derivation of the forward recursion equations for 

10 a k (s) in (19). Path metrics and the corresponding data d(k) bit 
for each trellis state are stored in a state matrix. The best 
path corresponding to decoding state k is used to select the best 
data d(k-D) bit decision at the state k-D of this path stored in 
the state matrix, where D is a delay in the data bit decisioning 

15 that is required for reliable decoding. 

Step 3 for our new backward recursion uses the same 
definition of b k -i(s') for the MAP turbo decoding in 1 in 
equations (15) with the modification that the a-priori 
probability p (x ( k) ) =p (d ( k) ) =0 corresponding to setting the 

20 probability p (d (k) =1) =p (d (k) =-1) =1/2 . Step 4 then follows the 
steps in equations (15) , (16) leading to the equations 2 in 
equations (17) for b k _i(s') for the MAP turbo decoding, upon 
replacing the summation over s with the maximization with respect 
to s similar to the derivation of the backward recursion 

25 equations for J3 k -i(s') in (20). Path metrics and the corresponding 
data d(k) bit for each trellis state are stored in a state 
matrix. The best path corresponding to decoding state k is used 
to select the best data d(k+D) bit decision at the state k+D of 
this path stored in the state matrix, where D is a delay in the 

30 data bit decisioning that is required for reliable decoding. 

Preferred embodiments in the previous description of the 
probabilities, decisioning metrics, algorithms, and 
implementations, are provided to enable any person skilled in 
the art to make or use the present invention. The various 
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modifications to these embodiments will be readily apparent to 
those skilled in the art, and the generic principles defined 
herein may be applied to other embodiments without the use of the 
inventive faculty. Thus, the present invention is not intended 
5 to be limited to the embodiments shown herein but is intended to 
be accorded the wider scope consistent with the principles and 
novel features disclosed herein. 

It should be obvious to anyone skilled in the 
communications art that these example probabilities, decisioning 

10 metrics, algorithms, and implementations, define the 

fundamental architecture and signal processing relevant to this 
invention disclosure and it is obvious that this example is 
representative of the other possible signal processing approaches 
For cellular applications the transmitter description in 

15 FIG. 2 for both turbo and convolutional encoding includes 
transmission signal processing applicable to this invention for 
both the hub and user terminals, and the receiver description in 
FIG. 4 includes equations (16) , (17) , (18) , (9) , (10) for our new 
turbo decoding and equations (21) for our new convolutional 

20 decoding and describes the corresponding receiving signal 
processing for the hub and user terminals for applicability to 
this invention. 

For optical communications applications the microwave 
processing at the front end of both the transmitter and the 
25 receiver is replaced by the optical processing which performs the 
complex modulation for the optical laser transmission in the 
transmitter and which performs the optical laser receiving 
function of the microwave processing to recover the complex 

baseband received signal. 
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